Apparatus, systems, and methods for providing three-dimensional instruction manuals in a simplified manner

ABSTRACT

Interactive, electronic guides for an object may include one or more 3D models, and one or more associated tasks, such as how to assemble, operate, or repair an aspect of the object. A user electronic device may scan an encoded tag on the object, and transmit the scan data to an electronic guide distribution server. The server may receive an electronic guide generated by an electronic guide generator having a 3D model repository and a task repository, the guide associated with the encoded tag. Guide managers may add or modify 3D models and/or tasks to broaden the available guides, and tag producers may generate encoded tags using new and/or modified 3D models and tasks and apply tags to objects.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of U.S. application Ser. No.15/561,909, filed Sep. 26, 2017 which is a 371 National Stage of PCTInternational Application No. PCT/US2016/024479, filed Mar. 28, 2016,which claims the benefit of U.S. Provisional Application No. 62/139,351,filed Mar. 27, 2015, the contents of both of these applications areincorporated by reference in their entirety.

STATEMENT REGARDING GOVERNMENT SUPPORT

None.

FIELD OF THE INVENTION

The present disclosure relates to applications, systems, and methods forgenerating and providing object guides, such as three-dimensionalproduct instruction manuals, in response to a scan of an object.

BACKGROUND INTRODUCTION

Electronic devices are capable of running applications (or “apps”) thatmay electronically display different types of guides pertaining to theoperation, repair, or assembly of various physical objects. Users mayhave need for these interactive electronic guides while using or workingon these objects. Although numerous printed and electronic interactiveguides are available, finding a particular guide—such as a guide for therepair of a specific part of a mechanical device—can be onerous attimes, and nearly impossible at others. For example, locating a guidefor an object, such as a lawn mower, purchased long ago or no longersupported by the manufacturer, may be difficult and burdensome,especially if the lawn mower broke down during the middle of mowing ayard. Further, many guides are difficult to use, and provide little (ifany) assistance with one or more specific tasks. Such complexityfrequently increases the difficulty and the overall time needed tolocate, receive, and use an interactive guide, especially at the pointof need, diminishing the user's ability to operate, repair, or assemblyan object. Additionally, the ability to collect useful data relating tothe use of a guide, for improving the content and effectiveness of theguide, is limited to voluntary user feedback. Manufacturers thereforehave limited means to determine how to enhance the usefulness of a guidefor users.

BRIEF SUMMARY

Apparatus, systems, and methods for providing guides based on electronicscanning of objects are disclosed. In some embodiments, a user may usean electronic device, such as a mobile phone with a camera or othersensor, to scan all or a portion of an object, packaging for the object,or material associated with the object. The scan may produce scan data.The device may include an app configured to use the scan data to locateand receive from a remote source, a guide related to the object, such asa maintenance or repair guide.

In some embodiments of the present approach, a user may scan an object,request a guide for the object, and access and/or use the interactiveguide for the object. The use may use an electronic device such as, forexample, a mobile electronic device like a smart phone, to scan andreceive scan data. In some embodiments, the electronic device mayinclude an app through which a user may scan an object, request aninteractive guide for the object, and/or access and/or use theinteractive guide for the object. One or more devices may be used toscan, request, and access, in various combinations. For example, amobile phone may be used to scan an object and request a guide, and aseparate projector system may receive and display the guide. As anotherexample, a handheld scanner may send scan data to a mobile device, andthe mobile device then receives a guide viewable on a monitor connectedto the mobile device.

Under the present approach, a number of scanning techniques may be usedto generate scan data. For example, in some embodiments, an electronicdevice may utilize near field communication (NFC) between itself and anNFC-enabled object. Other forms of wireless signal transmission andreceipt may be used, such as Bluetooth and RFID. Additionally anelectronic device may use optical scanning techniques, such as using abuilt-in camera or other optical sensors, to scan all or a portion of anobject. For example, a visual scan of an identifying mark on an object,such as, but not limited to, a bar code, a QR code, or symbols on amodel number panel, may be used in some embodiments. In someembodiments, an image of all or a portion of an object itself may bescanned, and the image used to identify the appropriate guide.

Under the present approach, a number of techniques may be used toidentify the appropriate guide(s) or portion(s) of guide(s) to deliver.In some embodiments, the electronic device determines the appropriateguide, such as through an app having access to the scan data. In someembodiments, the app may receive or analyze the scan data and compare toa database to determine the guide to request. For example, in someembodiments, an electronic device (or an app running on the electronicdevice) may identify the target object, then request an interactiveguide from a guide source, such as a cloud-based repository. Theelectronic device then receives and displays the guide to the user. Insome embodiments, a remote device, such as a server or database,determines the appropriate guide after receiving all or a portion of thescan data from the electronic device. For example, an electronic devicemay transmit scan data to a remote device operated by the app provider,guide provider, object manufacturer, or another third party. The remotedevice may analyze the scan data to identify one or more guides totransmit. In some embodiments, the electronic device may receive a listof available guides. In some embodiments, the electronic device mayreceive one or more suggested guides.

The present approach is not limited to a type of guide. There are manyforms of product guides, ranging from paper-based guides to electronicguides, and static guides to interactive and smart guides. Under thepresent approach, a user may receive one or more guides of any variety.In some embodiments, a guide may be generated or modified in response toa scan data, to maximize the usefulness to the user.

In some embodiments, use of the guide may be monitored in a manner togenerate useful data about use of the guide and the guide itself. Usefuldata may include, for example, the time a user spends on a certainaspect of a guide, the number of times a user repeats or replays anaspect of a guide, the frequency of using a guide, and so on. Such datamay be used to refine or improve aspects of the guide, such as improvingthe description of a particular aspect or improving an explanation orstep, such that the usefulness and effectiveness of the guide mayimprove over time. Embodiments may include feedback mechanisms for usersto provide feedback on a guide, such as the usefulness of an aspect of aguide, the need to include an additional topic or clarify a step, orother suggestions.

Embodiments of the present approach may take the form of a system fordisseminating electronic guides. The system may include an electronicguide generator having (1) a 3D model repository with a plurality of 3Dmodels, each 3D model associated with an encoded tag, and (2) a taskrepository having a plurality of tasks, each task associated with anencoded tag. The system may also include a plurality of user electronicdevices, each user electronic device having (1) a scanner configured toscan an encoded tag on an object to generate a scan data including dataassociated with the encoded tag, (2) a scan data transmitter configuredto transmit scan data, (3) an electronic guide receiver configured toreceive an electronic guide, and (4) a display configured to display thereceived electronic guide. In some embodiments, the user electronicdevice may be configured to transmit usage data, usage data comprisingdata relating to the use of an electronic guide. The system may alsoinclude an electronic guide distribution server in electroniccommunication with the electronic guide generator and the plurality ofuser electronic devices, and configured to (1) receive a scan data froma user electronic device, (transmit the scan data to the electronicguide generator, (3) receive an electronic guide from the electronicguide generator, the electronic guide associated with the scan data, and(4) transmit the electronic guide to a user electronic device.

In some embodiments, the electronic guide comprises at least one 3Dmodel and at least one task associated with the scan data. The 3D modelmay show all or a portion of an object. The tasks may relate toinstructions or guidance for operating, assembling, and/or repairing allor a portion of the object. For example, a task may comprise at leastone instructional sequence relating to an aspect of an object, and theat least one instructional sequence is associated with at least one 3Dmodel. The encoded tag in some embodiments may correspond to an aspectof the scanned object, and the electronic guide comprises at least one a3D model and a task associated with the aspect of the scanned object.

In some embodiments, the system may include at least one electronicguide manager, the at least one electronic guide manager incommunication with the electronic guide generator and configured to atleast one of add a new 3D model to the electronic guide generator,modify an existing 3D model in the electronic guide generator, add a newtask to the electronic guide generator, and modify an existing task inthe electronic guide generator.

Some embodiments may include at least one encoded tag producer. The atleast one encoded tag producer may be configured to receive an encodedtag order and generate one or more new encoded tags associated with oneor more 3D models and one or more tasks. The encoded tag producer may beconfigured to apply a new encoded tag to an object. The encoded tagproducer may be configured to generate one or more new encoded tagsassociated with an aspect of an object and one or more 3D models and oneor more tasks, the one or more 3D models and one or more tasksassociated with the aspect of the object.

In some embodiments the 3D model repository may have 3D model objectdata, and the electronic guide distribution server may be configured to(1) convert the 3D model object data into a delivery format, and (2)transmit the 3D model delivery format to the user electronic device.

Some embodiments of the present approach may take the form of a process.For example, a process for disseminating electronic guides may involvereceiving, at an electronic guide distribution server, an electronicguide request from a user electronic device, the electronic guiderequest including a scan data of an object, the scan data including dataassociated with an encoded tag; generating, at an electronic guidegenerator, an electronic guide for the object based on the dataassociated with the encoded tag, the electronic guide comprising atleast one 3D model and at least one task associated with the object; andtransmitting the electronic guide to the user electronic device.

In some embodiments, the at least one 3D model may be selected from a 3Dmodel repository with a plurality of 3D models, each 3D model associatedwith an encoded tag; and the at least one task may be selected from atask repository having a plurality of tasks, each task associated withan encoded tag. Some embodiments may include receiving from the userelectronic device usage data comprising data relating to the use of anelectronic guide. Some embodiments include receiving, at the electronicguide generator, at least one of a new 3D model and a new task, from anelectronic guide manager, and updating at least one of the 3D modelrepository and the task repository.

In some embodiments, the scan data may include data associated with anaspect of the object, and the electronic guide is associated with theaspect of the object. In some embodiments, the process may include (1)retrieving object data from at least one of the 3D model repository andthe task repository, the object data including 3D model data and taskdata, and (2) converting the object data into a delivery format fortransmission to the user electronic device. Generating the electronicguide for the object may include, for some embodiments, identifying atleast one 3D model in a 3D model repository associated with the dataassociated with the encoded tag; identifying at least one task in a taskrepository associated with the data associated with the encoded tag; andcombining the at least one 3D model and the at least one task to form anelectronic guide associated with the object.

Embodiments of the present approach may also take the form of a systemfor generating electronic guides. The system may include an electronicguide generator having (1) a 3D model repository with a plurality of 3Dmodels, each 3D model associated with an encoded tag, and (2) a taskrepository having a plurality of tasks, each task associated with anencoded tag; an electronic guide distribution server configured to (1)receive a scan data from a user electronic device, (2) transmit the scandata to the electronic guide generator, (3) receive an electronic guidefrom the electronic guide generator, the electronic guide associatedwith the scan data, and (4) transmit the electronic guide to a userelectronic device; and an encoded tag producer configured to receive anencoded tag order and generate a new encoded tag associated with one ormore 3D models and one or more tasks.

An electronic guide manager in some embodiments may be configured to atleast one of add a new 3D model to the electronic guide generator,modify an existing 3D model in the electronic guide generator, add a newtask to the electronic guide generator, and modify an existing task inthe electronic guide generator. In some embodiments, the electronicguide manager is configured to issue a new encoded tag order to theencoded tag producer, the new encoded tag order associated with at leastone of add a new 3D model, a modified existing 3D model, a new task, anda modified existing task.

These and other features will become apparent in view of the drawingsappended hereto and the description and claims that follow.

DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic showing the contextual flow of data in anembodiment of the present approach.

FIG. 2 is a diagram showing the physical flow of data between elementsin an embodiment of the present approach.

FIG. 3 shows the logical data flow for an embodiment of the presentapproach.

FIG. 4 is a series of flowcharts showing a process for providinginteractive and three-dimensional manuals for a manufacturer's product,and for collecting related data thereto, according to an embodiment ofthe present approach.

FIG. 5 shows an example of a hardware architecture according to anembodiment of the present approach.

DESCRIPTION

Many people use guides for various objects ranging from lawn mowers towireless routers, but accessing and using these guides effectively atthe point of need may be onerous. For example, a user may need to knowhow to change a tire on a car. By employing embodiments of theapparatus, systems, and/or methods described herein, the user may simplyscan the tire that needs to be changed using, for example, a mobilephone, and receive an interactive 3D3D guide for the specific car andhaving a step-by-step instructions for changing the tire. In someembodiments, the interactive 3D guide may be synchronized to the user'slive view, greatly increasing the effectiveness of the instructionguide. For example, a user may position a mobile device camera facingthe tire in the previous example, and the 3D guide may superimpose overthe tire as seen from a viewing screen on the mobile device. In someembodiments, the synchronized guide may indicate locations of aspects ofthe object, such as lug nuts and where to safely position a car jack.

The apparatus, systems, and methods described herein may be applied innumerous scenarios, and across several industries. For example, a usermay want a detailed view of the interior of a real estate property.Currently a user may be able to view images on a website and schedule alive appointment to walk through the property. However, using anembodiment of the present approach, a simple sales sheet can be scannedand a comprehensive and immersive 3D view of the property can be sent tothe user's electronic device, allowing the user to virtually walkthrough the property from a remote location.

As another example, embodiments of the apparatus, systems, and/ormethods described herein may be used by a user who has purchased a pieceof furniture that requires assembly. Typically, the user would follow apaper-based manual to assemble the item. Such manuals frequently includeinadequate explanations of steps and line drawings that are hard tounderstand, complicating the process of assembling the furniture.However, by using embodiments of the apparatus, systems, and/or methodsdescribed herein, the user may scan the furniture packaging (or anotheraspect of the item), and receive an interactive 3D guide for theassembly of the item. In some embodiments, that the interactive guidecan be aligned with the user's view of the unassembled item and providelive assembly instructions, greatly enhancing user's ability to assemblethe item.

In the embodiments described herein, the “user” generally refers to theindividual or entity (e.g., multiple people) seeking a guide for anobject. As indicated above, the “object” may be any item for which oneor more guides may be available, and can include, for example and withno intention of limiting the scope of this disclosure, mechanicaldevices and tools, electronic devices and tools, automobiles, furniture,properties, etc. Although many of the exemplar embodiments describedherein are for physical objects, the object may be a portion of acomputer program or software application, such as a particular screen,for which a user requires assistance completing a task or solving aproblem. Generally, an “electronic device” may be any device capable ofscanning an object, an aspect of an object (such as a bar code, QR code,or part of an object) an item associated with an object (e.g.,packaging, invoice, receipt, marketing material, etc.). In someembodiments, the electronic device may be capable of transmitting scandata, or other data based on scan data, to server or other component.For example, in some embodiments, the electronic device may beconfigured to analyze the scan data and determine the guide(s) and/orportions of guide(s) that the user should receive. The “scan data” maybe any data received from the scan, and may depend on the type of scan.Non-limiting examples of scan data include any of, or a combination of,imagery, bar code or QR code data, RFID data, symbols, etc.

A “guide” may be a collection of data describing one or more features ofan object, such as how use, repair, and/or assemble the object or aportion of the object. The present approach is not intended to belimited to a type of guide. There are many forms of product guides,ranging from paper-based guides to electronic guides, and static guidesto interactive and smart guides. Under the present approach, a user mayreceive one or more guides of any variety. In some embodiments, a guidemay be generated or modified in response to a scan data, to maximize theusefulness to the user. For example, some embodiments may analyze thescan data, identify the object and one or more specific aspects of thatobject, then generate and deliver an interactive guide providing a 3Dvisualization of the object or aspect(s), along with additional audioand/or visual information related to the generated guide determined tobe relevant to the scan data.

In some embodiments, a system may feature an object, one or more guidesfor the object, a device scanning an aspect of the object, a devicerequesting one or more guides for the object, a device providing one ormore guides in response to a request, a device receiving and displayingthe guide(s), and various request and usage data. A guide for an objectmay include a 3D model of the object and correlated instructionalcontent (or other information related to the object). The system mayalso feature an electronic device capable of scanning an aspect of theobject (such as, for example only, a part of the object itself,packaging for the object, or other material relating to the object). Thesystem may include one or more devices to identify the object from thescan data, identify the appropriate guide(s), and display the guide.Those devices may be the same electronic device that scans the object,or more than one device sharing data. Displaying the guide may includedisplaying the 3D object model and correlated instructional content asan interactive presentation to the user.

The 3D model of the object may take several forms, but generally will bea digitized version of all or a portion of the object that can be viewedfrom more than one perspective. The model can be, for example, a singletriangulated mesh structure of the object, a model of each individualcomponent and subcomponent that make up the object or a portion thereof,such as a CAD or engineering model, or various 3D images prepared usingvarious animation and/or graphics techniques. In some embodiments, theguide may include instructional content. Instructional content mayinclude, for example, step-by-step instruction(s) or other informationrelating to all or a portion of the object. The instructional contentmay be correlated with defined states of the 3D model or other imageryused in a guide. For example, a state of the 3D model can be a specificviewpoint of the 3D model and/or an assembly state of the model, and oneor more steps or other information may be presented in view of theparticular viewpoint or assembly state. Information may be presentedvisually, such as text and or other symbols or images, audibly, andcombinations thereof. In some embodiments, information may be providedthrough feedback by an electronic device. For example, in an embodimentin which a model is superimposed over a live view, the electronic devicemay vibrate if a user attempts to manipulate an incorrect component. Thedevice may use different forms of feedback, such as different soundsand/or different vibrational patterns.

Embodiments may generate, store, and distribute guides in one or moremanners. Some embodiments use a web-based management application thatallows a manager to create and maintain a guide. For example, a managermay use an application to prepare instructional content, and correlatethe content with object imagery, such as a 3D object model. Inembodiments, a manager may upload a guide through an application. One ormore central servers may be used to host guides. In some embodiments,guides may be hosted on distributed servers, such as servers operated byor for the manufacturer of an object. An application may communicatewith the server to request a guide, and the server may transmit a guidein response to the request. In some embodiments, the request may includeadditional data. The additional data may be used for one or morepurposes, such as to pinpoint a portion of a guide, determine whichguide(s) should be provided, and to generate a specific guide, forexample.

Under the present approach, a user receives one or more guides inresponse to a request and/or transmission of scan data. In someembodiments, the device used to scan an object and transmit the scandata may be a mobile electronic device, such as a mobile phone or PDA.The scan may utilize one or more embedded electronic tags or physicaldepth scanning to identify the object (or portion of the object ormaterial associated with the object) being scanned. The scan producesscan data. The particular scan data will depend on the method ofscanning. In some embodiments, object-specific data files relating toone or more guides (such as, for example, 3D model plus instructionaldata) are downloaded and then displayed for the user in response to thetransmission of the scan data or request for a guide In someembodiments, the guide may be displayed as interactive 3D views that maybe manipulated directly on the device. In some embodiments, aspects ofthe guide, such as a 3D model, may be manipulated through the use ofaugmented reality views. In some embodiments, the 3D model may bedirectly overlaid onto a live view of the object. By using a 3D modelfor the basis of a guide, instead of static or predefined images of theobject, the same data may support a wide range of viewing modalities.Thus, embodiments of the present approach may be adapted for use with awide variety of electronic devices and display capabilities.

Turning to a description of the embodiments shown in the drawings, FIG.1 shows a schematic of the overall contextual data flow in oneembodiment of the present approach. In this embodiment, the processgenerally connects a user 5 with a manager 1. The manager 1 may be, forexample, a provider of a guide, including, for example, one or more 3Dmodels of an object and related instructional or procedural data. Insome embodiments, manager 1 may be a party responsible for satisfyingrequests for guides for one or more objects. In some embodiments,manager 1 may be the manufacturer or retailer of an object. The user maybe the user of the object seeking a guide. The manager 1 provides objectdata 2 to the 3D instructional manual distribution process 3. In someembodiments, the process may be operated by the manager. The manager mayoperate the process on a manager-owned and/or manager-operated serversystem, or alternatively using a third-party server system such as acentral server system. In some embodiments, the process may be operatedby a third party, such as an intermediary. The intermediary may operatea central sewer system to run all or a portion of process 3. In someembodiments, portions of process 3 may be performed separately. Forexample, manager 1 may perform a portion of process 3, and anintermediary may perform a portion of process 3.

In some embodiments, object data 2 includes one or more 3D models of theobject (or a component thereof), and instructional sequences correlatedto the 3D model. The process 3 then generates encoded tags 4 that themanager 1 can apply to one or more objects 8. An encoded tag 4 can be ina form readable from an electronic device, including but not limited toNFC chips, QR codes, or managed 3D focal points. Depending on the tagencoding used, the tags in some embodiments may be model-specific orindividual item-specific. For example, model-specific tags may relate toa model number, and thus apply to any object having a model number,whereas an item-specific tag would be tied to an object serial number orto a one of a kind object.

In the embodiment shown in FIG. 1, once the tags have been encoded andintegrated into the object 8, a user 5 may scan 6 the object 8) andinitiate an instruction manual request 7. The user 5 then receives oneor more interactive instruction manuals 8. In some embodiments, duringthe use of the interactive instruction manual 8, usage data 9 iscaptured and provided to the manager 1 for subsequent usage andimprovement analytics 10. Usage data 9 may include numerous categoriesof data.

FIG. 2 shows the physical flow of data between elements betweencomponents in an embodiment of the present approach. With respect toFIG. 2, a manager may be a party generating, maintaining, offering,and/or providing one or more guides for one or more objects. The manager11 may upload object data. 12 to a server 15 via an electronic channel,such as web-based application 13. One of ordinary skill in the artshould appreciate that other electronic channels, such as physical discsor drives, email or FTP, etc., may be used as an electronic channel inother embodiments. Web-based application 13 may be an applicationconfigured to receive information from manager 11 relating to a guide,process the information as needed to prepare a guide, and provide theguide to a server 15. In some embodiments, web application 13 may besoftware operating at the manager side, the server side, or both. Objectdata may include, for example, 3D models of the object in whole or atvarious levels sub-assemblies, wiring data, internal structureconnections along with specific techniques, tactics, and procedures(TTPs) pursuant to operation, maintenance, or assembly of the object. Itshould be appreciated that the specific content of object data maydepend on the type of guide(s), model(s), and instruction or othercontent. In some embodiments, for example, the object data may includethree-dimensional imagery at the resolution and detail required by theassociated TTPs. One of ordinary skill in the art should appreciate thatobject data may depend on the type of guide being provided, and may varyfrom one guide to the next. A 3D model 14 may be uploaded to the server15 and, if desired, converted for online data storage 16. For example,in some embodiments, raw object data may be converted into another formfor optimal streaming and viewing across web enabled applications. The3D model 14 may be part of object data 12 uploaded by manager 11. Insome embodiments, web application 13 may generate a 3D model based ondata included in object data 12.

In some embodiments, the guide may include tasks 17 to convey additionalinformation to a user. Generally, a task 17 may be additionalinformation relating to the object, such as a repair step, maintenancestep, action, or other information relating to the object. A task may beinformation such as text, images, audio, video, etc., or combinationsthereof. Tasks 17 may be uploaded as part of object data 12 and/or maybe added through other interaction with web application 13. For example,in the embodiment shown in FIG. 2, the online view of the 3D model 14may stream back through the server 15 and be presented via the web app13 to the manager 11. The manager 11 may then add additional object data12 by selecting various views and states of a 3D model 14 via the webapplication 13, and associate one or more tasks with a particularcombination of view(s) and/or state(s). For example, in someembodiments, a task may be associated with one or more views and/orstates of a 3D model, such that the associated views) and/or state(s) ofthe model are viewed in connection with the task. These selections maybe sent as tasks 17 to the server 15, and stored for retrieval 18. Insome embodiments, manager 11 may include tasks 17 in object data 12transmitted to web application 13. In some embodiments, one or moretasks 17 may be transmitted directly to server 15. Once the 3D model 14and tasks 17 are finalized, the manager 11 may add any additional objectdata 12 related to how the object will be tagged 19. Object tagparameters 19 transfer from the web application 13 to the server 15, andsoftware running on the server 15 may generate a tag production order 20for the tag producer 21. Tag producer 21 may be a process formanufacturing tags, including electronic tags and physical tags. In someembodiments, tag producer 21 may be a software module operated by manger11 or by a third party, such as a party operating a server 15. The tagproducer 21 produces one or more encoded tags 22 in response to theproduction order 20. In some embodiments, all or a portion of tagproducer 21 may prepare physical tags in response to a tag productionorder 20. In some embodiments, tag producer 21 may prepare a tagproduction order 20 specifying the parameters for a tag, and themanufacture of a tag may be performed by a third party in response tothe tag production order 20. In some embodiments, a tag production order20 may call for the production of a 3D scan tag. An encoded tag 20 canbe integrated into the object 23 or data associated with the object, orotherwise associated with the object. For example, a physical tag, suchas a bar code or RFID, may be affixed or built into an object. In someembodiments, the tag may be included in packaging or material associatedwith the object. A scan may use an integrated encoded tag 20 to generatescan data that may be used to identify the object and request one ormore appropriate guides.

A user 24 may initiate an instruction manual request 25 via a mobiledevice (or other electronic device) 26. In this embodiment, user 24 mayscan the object 27 to generate scan date 28. Scan data may includeinformation for identifying the object 23 and/or the guide(s) torequest. For example, mobile device 26 may receive scan data in the formof object and app data 28 from the scan. It should be understood thatalthough the guide described in the embodiment shown is an instructionmanual, other types of guides may be used as described above. After thedevice 26 receives scan data, one or more elements in the system (e.g.,mobile device 26, server 15, web application 13) may analyze the scandata to identify the object 23 and/or determine the guide(s) to request.

Embodiments of the present invention may include a specific app on anelectronic device to perform one or more of receiving scan data,analyzing scan data, and/or transmitting scan data or other informationto request one or more guides. One of ordinary skill in the art shouldappreciate that one or more apps may be used for these features, andthat other software (e.g., programs operating on the mobile device orother devices) may be used to perform all or a portion of thesefeatures. For example, some embodiments may use a feature of anelectronic device to perform the object scan 27. In some embodiments,the object scan 27 may trigger the mobile device 26 to open targeted app29. If targeted app 29 does not exist on the mobile device 26, then themobile device 26 may, in some embodiments, automatically initiate arequest to an app server 30, such as iTunes, based on a target app ID31, to request transmission 32 of the targeted app 29 to be installed onthe mobile device 26. With die targeted app 29 in place, the processshown in the embodiment of FIG. 2 can continue with the targeted app 29sending the scanned object ID 33 to the server 15. In other embodiments,targeted app 29 may transmit other data, such as all or a portion of thescan data, or other data representing an analysis of the scan dataand/or request for one or more guides. In some embodiments, the user 24may be prompted to input additional data, such as a confirmation orselection input. The additional data may be included in the informationtransmitted in a request for a guide. Upon receipt of scanned object ID33, server 15 may identify or selected the requested 3D model 16 andtasks 18 from the data stores. In some embodiments, server 15 mayconstruct app-readable object data 34 for transmission and download bythe targeted app 29 or another application on an electronic device, suchas the mobile device 26. In this embodiment, targeted app 29 thentranslates the app-readable object data 34 for display as an interactiveinstruction manual 34 for the user 24. As described above, theinteractive instruction manual 34 may be displayed on mobile device 26or another electronic device. In some embodiments, user usage data 35transferred via the targeted app 29 to the server 15, and stored 36 forsubsequent analysis. The usage analytics 37 are then able to bedelivered to the manager 11 via the web app 13. Other embodiments mayperform user usage data receipt, storage, and analysis at differentpoints in the system. For example, usage data 35 may be transferreddirectly to manager 11 in some embodiments. In some embodiments, usagedata 35 may be collected from multiple sources, such as various users,one or more servers, etc., to provide broad data collection. Also, usagedata 35 may be collected at different times, such as at the object scan27, transmission of object ID 33, etc. Usage data 35 may include one ormore of an aspect of the object scan 27, information about object 23(e.g., serial number, model number, etc.), guide(s) requested, timespent using a guide, time spent on various portions of a guide, numberof repeats of a portion of a guide, user feedback, etc. Generally, usagedata 35 may include any data that may be useful or valuable to manager11, such as for improving a guide and improving an object. Thus, in someembodiments, manager 11 may specify the contents of usage data 35.

It should be appreciated from the foregoing that numerous logical flowsmay be used to implement the present approach. FIG. 3 shows the logicaldata flow for one embodiment. The first process in this embodiment isthe “Add object data to server” process 301. This process enables amanager 11 with a guide for an object, such as a 3D model or otherinformation for a guide, to input data to a server database 15 where theobject data 15 may be used to provide interactive instruction manuals34. The second core process is the encoding of tags 302. In thisprocess, the manager 11 may establish the identification tagging for theobject, and receive encoded tags 22 that can be integrated into theobject. Encoded tags 22, may be physical tags, such as a bar code or QRcode applied to an object or manual associated with the object. In someembodiments, an encoded tag 22 may be an RFID, Bluetooth device, orsimilar near-proximity signal. In some embodiments, an encoded tag maybe a recognizable configuration of all or a portion of an object, suchas a view of the object from a specific angle and approximate distance.In such embodiments, a targeted app may be configured to analyze animage captured by the mobile device to identify the tag.

After object data 12 has been loaded to a database 15 the server 15 maybegin the “convert object data to delivery format” process 303. Inprocess 303, a program operating on server 15 (or in some embodiments,other components of the system, such as on the manager side) convertsobject data 12 for use by various mobile applications, such as atargeted 29 on a user's mobile device 26. Processes 301, 3012, and 303may be repeated as a manager 11 uploads object data 12 for more objects,multiple guides for an object, or updates/revises object data 12. Withprocesses 301-303 complete, a user 24 can initiate the “ObtainInteractive Instruction Manual” process 304. This process 304 centersaround the scanning of an object and/or one or more of any encoded tagsassociated with an object, and the receiving of the interactiveinstructional manual 34. In some embodiments, process 304 may beperformed via a mobile device targeted application 29. Process 304 mayalso include elements relating to the capture of usage data 35 fromusers 24 of the interactive instruction manual. As described above,usage data 35 can range from registering a specific serial number to auser account to what training tasks and steps are most frequentlyrequested and usage for a given object. In some embodiments, the usagedata capture process may be a separate process 305. In some embodiments,process 305 may analyze collected data for desired metrics and outputsanalyzed results back to the manager 11. It should be appreciated thatthe logical data flow shown in FIG. 3 represents one embodiment of thepresent invention, and that other logical data flows may be usedconsistently with the present approach.

Similarly, one of ordinary skill in the art should appreciate that thepresent approach may be practiced using one or more algorithms. FIG. 4is a series of flowcharts showing embodiments of algorithms forproviding interactive manuals for a manufacturer's product, and forcollecting related data thereto. The flowchart in FIG. 4 shows the flowof data across various components in one embodiment: mobile device 26,object 23, app server 30, mobile app 29, server 15, web app 13, and tagproducer 11. In this embodiment, user 26 scans an object for anelectronic tag S401. As described above, there are many types of tagsthat may be used, and in some embodiments an image of the object or anaspect of the object may be used. Tags are provided S402, andtransmitted in the form of an object ID and an App IP to the user'smobile device S405. In some embodiments, the targeted app may vary fromone object to another. For example, a manufacturer may have a specifictarget application for certain objects. In some embodiments, the user'smobile device may receive scan data and determine the object ID and/orApp ID. In some embodiments, a tag may include the object ID and/or AppID. After receiving an App ID, the user's device may determine whetherthe targeted application is present on the device S404. If not, theprocess may initiate a request to download and install the targeted appS405. If the targeted app is present, the mobile device may initiate arequest to open the targeted app S406.

In step S407, the targeted app 29 may request a guide from server 15,such as an interactive instruction manual 25. In some embodiments, thetargeted app 29 may request object data from server 15, and receive datafrom the server S410. From the received data, the targeted app maydisplay the guide, such as a 3D model and associated tasks S411. In someembodiments, the mobile device may capture usage data S412, as describedabove.

As shown in FIG. 4, the manager 11 may upload object data 12 such as a3D model S413. The object data 12 may be uploaded to a web app asdescribed above, and in some embodiments may be uploaded to a serverdatabase. In some embodiments, server 15 translates object data 12 intomodel 16 and tasks 18, for other steps S409 and S419. In someembodiments, a web app or other process may prepare the guide forultimate transmission. The manager 11 may receive and parse object dataS414, and may use a task creator S415 to add, remove, and/or edit tasksand other elements of a guide S416. Manager 11 may further request tagsS417 for the object relating to the guide associated with object datauploaded. In the embodiment shown, server 15 may respond by generatingan encoded tag S419. In some embodiments, tags may be generated by themanager 11, or by another party, such as, for example, through anexternal vendor. In some embodiments, a tag may include data to identifyau object from an image. Tags may be associated with an object, such as,for example, physically attaching a tag to an object, electronicallyassociating a tag with an object, and/or associating image informationwith an object's identification. In some embodiments, a tag producer 21may receive a tag production order S421, and prepare physical orelectronic tags S422. After a user has requested a guide, manager 11 mayin some embodiments request usage data S418. Generally, a manager 11 mayuse usage data 35 to improve an object, such as its manufacture orfeatures, improve a guide, such as the clarity of tasks or usefulness ofa 3D model, among other valuable uses. In some embodiments, server 15may perform various analytics S420.

FIG. 5 shows an example hardware architecture according to an embodimentof the present approach. A server 15 may include databases having 3Dmodels 16, task data 18, user information 24, and usage data 35. Indifferent embodiments, one or more of these databases may be maintainedin a separate electronic device. Server 15 may also include variousapplications 51, such as, for example, a 3D model parser 51 a, adocument writer 51 b, a tag writer 51 c, and a video streamer 51 d.Server 15 may also include a web service application programminginterface 52.

An object 23 may include one or more tags, such as electronic tag 22that identifies a model number and/or a serial number for object 23. Asdescribed above, a tag may be in many forms, such as physical orelectronic, and an object may have more than one tag.

A user may have an electronic device, such as a mobile computing device26 with a target app 29 as described above. A user may use more than oneelectronic device, such as, for example, a scanner to scan an object, acommunications device to transmit scan data and/or make a request for aguide, and a display device for receiving and displaying a guide.

A manager may use an electronic device to provide object data 12, whichmay include 3D model data and one or more tasks associated with theguide. In some embodiments, a manager may interact with a system asdescribed herein through a web app 14. In some embodiments, the servermay provide secure web service APIs that can enable one or more thirdparty applications 53 to utilize existing data stores for display withintheir customized client applications.

As will be appreciated by one of skill in the art, aspects or portionsof the present approach may be embodied as a method, system, and atleast in part, on a computer readable medium. Accordingly, the presentapproach may take the form of combination of hardware and softwareembodiments (including firmware, resident software, micro-code, etc.) oran embodiment combining software and hardware aspects that may allgenerally be referred to herein as a “circuit,” “module” or “system.”Furthermore, the present approach may take the form of a computerprogram product on a computer readable medium having computer-usableprogram code embodied in the medium. The present approach might alsotake the form of a combination of such a computer program product withone or more devices, such as a modular sensor brick, systems relating tocommunications, control, an integrate remote control component, etc.

Any suitable non-transient computer readable medium may be utilized. Thecomputer-usable or computer-readable medium may be, for example but notlimited to, an electronic, magnetic, optical, electromagnetic, infrared,or semiconductor system, apparatus, device, or propagation medium. Morespecific examples (a non-exhaustive list) of the non-transientcomputer-readable medium would include the following: a portablecomputer diskette, a hard disk, a random access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), an optical fiber, a portable compact disc read-onlymemory (CD-ROM), an optical storage device, a device accessed via anetwork, such as the Internet or an intranet, or a magnetic storagedevice. Note that the computer-usable or computer-readable medium couldeven be paper or another suitable medium upon which the program isprinted, as the program can be electronically captured, via, forinstance, optical scanning; of the paper or other medium, then compiled,interpreted, or otherwise processed in a suitable manner, if necessary,and then stored in a computer memory. In the context of this document, acomputer-usable or computer-readable medium may be any non-transientmedium that can contain, store, communicate, propagate, or transport theprogram for use by or in connection with the instruction executionsystem, apparatus, or device.

Computer program code for carrying out operations of the presentapproach may be written in an object oriented programming language suchas Java, C++, etc. However, the computer program code for carrying outoperations of the present approach may also be written in conventionalprocedural programming languages, such as the “C” programming languageor similar programming languages. The program code may execute entirelyon the user's computer, partly on the user's computer, as a stand-alonesoftware package, partly on the user's computer and partly on a remotecomputer or entirely on the remote computer or server. In the latterscenario, the remote computer may be connected to the user's computerthrough a local area network (LAN) or a wide area network (WAN), or theconnection may be made to an external computer (for example, through theInternet using an Internet Service Provider).

The present approach is described below with reference to flowchartillustrations and/or block diagrams of methods, apparatus (systems) andcomputer program products according to embodiments of the approach. Itwill be understood that each block of the flowchart illustrations and/orblock diagrams, and combinations of blocks in the flowchartillustrations and/or block diagrams, can be implemented by computerprogram instructions. These computer program instructions may beprovided to a processor of a general purpose computer, special purposecomputer, or other programmable data processing apparatus to produce amachine, such that the instructions, which execute via the processor ofthe computer or other programmable data processing apparatus, createmeans for implementing the functions/acts specified in the flowchartand/or block diagram block or blocks.

These computer program instructions may also be stored in anon-transient computer-readable memory, including a networked or cloudaccessible memory, that can direct a computer or other programmable dataprocessing apparatus to function in a particular manner, such that theinstructions stored in the computer-readable memory produce an articleof manufacture including instruction means which implement thefunction/act specified in the flowchart and/or block diagram block orblocks.

The computer program instructions may also be loaded onto a computer orother programmable data processing apparatus to specially configure itto cause a series of operational steps to be performed on the computeror other programmable apparatus to produce a computer implementedprocess such that the instructions which execute on the computer orother programmable apparatus provide steps for implementing thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

Any prompts associated with the present approach may be presented andresponded to via a graphical User interface (GUT) presented on thedisplay of the mobile communications device or the like. Prompts mayalso be audible, vibrating, etc. Any flowcharts and block diagrams inthe Figures illustrate the architecture, functionality, and operation ofpossible implementations of systems, methods and computer programproducts according to various embodiments of the present approach. Inthis regard, each block in the flowchart or block diagrams may representa module, segment, or portion of code, which comprises one or moreexecutable instructions for implementing the specified logicalfunction(s). It should also be noted that, in some alternativeimplementations, the functions noted in the block may occur out of theorder noted in the figures. For example, two blocks shown in successionmay, in fact, be executed substantially concurrently, or the blocks maysometimes be executed in the reverse order, depending upon thefunctionality involved. It will also be noted that each block of theblock diagrams and/or flowchart illustration, and combinations of blocksin the block diagrams and/or flowchart illustration, can be implementedby special purpose hardware-based systems which perform the specifiedfunctions or acts, or combinations of special purpose hardware andcomputer instructions.

The terminology used herein is for the purpose of describing particularembodiments only and is not intended to be limiting of the approach. Asused herein, the singular forms “a,” “an,” and “the” are intended toinclude the plural forms as well, unless the context clearly indicatesotherwise. It ill be further understood that the terms “comprises”and/or “comprising,” when used in this specification, specify thepresence of stated features, integers, steps, operations, elements,and/or components, but do not preclude the presence or addition of oneor more other features, integers, steps, operations, elements,components, and/or groups thereof.

The invention may be embodied in other specific forms without departingfrom the spirit or essential characteristics thereof. The presentembodiments are therefore to be considered in all respects asillustrative and not restrictive, the scope of the invention beingindicated by the claims of the application rather than by the foregoingdescription, and all changes which come within the meaning and range ofequivalency of the claims are therefore intended to be embraced therein.

What is claimed is:
 1. A system for disseminating electronic guides, thesystem comprising: a database having a 3D model repository with aplurality of 3D models, each 3D model associated with a physical objectand an encoded tag, and a task repository having a plurality of tasks,each task associated with at least one physical object and at least oneencoded tag, the task having instructions relating to the at least onephysical object; an electronic guide generator configured to generate anelectronic guide having at least one 3D model from the 3D modelrepository and at least one task from the task repository in response toreceiving a generation instruction from an electronic guide distributionserver; the electronic guide distribution server in electroniccommunication with the electronic guide generator and configured toreceive from a first user electronic device a first encoded tag dataassociated with a first physical object, transmit a first generationinstruction the electronic guide generator associated with the firstencoded tag data, receive a first generated electronic guide from theelectronic guide generator associated with the first physical object andthe first encoded tag data, transmit the first generated electronicguide to the first user electronic device, and receive a firsttransmitted usage data from the first user device; and an electronicguide manager configured to improve the first generated electronic guideby at least one of adding a new task to the task repository and modifyan existing task in the task repository in view of the first receivedusage data.
 2. The system of claim 1, wherein the electronic guidedistribution server is configured to receive from a second userelectronic device a second encoded tag data associated with a secondphysical object, transmit a second generation instruction the electronicguide generator associated with the second encoded tag data, receive asecond generated electronic guide from the electronic guide generatorassociated with the second physical object and the second encoded tagdata, transmit the second generated electronic guide to the second userelectronic device, and receive a second transmitted usage data from thesecond user device; and wherein the electronic guide manager isconfigured to improve the first generated electronic guide by at leastone of adding a new task to the task repository and modify an existingtask in the task repository in view of the first received usage data andthe second received usage data.
 3. The system of claim 2, wherein theelectronic guide manager is configured to improve the second generatedelectronic guide by at least one of adding a new task to the taskrepository and modify an existing task in the task repository in view ofthe first received usage data and the second received usage data.
 4. Thesystem of claim 1, further comprising a plurality of user electronicdevices, each user electronic device having: a scanner configured toscan an encoded tag on an object to generate the scan data includingdata associated with the encoded tag, a scan data transmitter configuredto transmit scan data, an electronic guide receiver configured toreceive an electronic guide having at least one 3D model and at leastone task, and a display configured to display the received electronicguide and instructions for performing at least one physical manipulationof the at least one physical object associated with the at least onetask; wherein each user electronic device is configured to transmitusage data to the electronic guide distribution server, the transmittedusage data relating to the use of a generated electronic guide, timeusing a generated electronic guide, and number of repeats of a portionof a guide.
 5. The system of claim 1, wherein the first electronic guidecomprises at least one model from the 3D model repository and aplurality of tasks from the task repository associated with the firstphysical object.
 6. The system of claim 2, wherein the second electronicguide comprises at least one model from the 3D model repository and aplurality of tasks from the task repository associated with the secondphysical object.
 7. The system of claim 1, wherein the first encoded tagdata corresponds to an aspect of the first physical object, and thefirst generated electronic guide comprises at least one 3D model and atleast one task associated with the first physical object.
 8. The systemof claim 2, wherein the second encoded tag data corresponds to an aspectof the second physical object, and the second generated electronic guidecomprises at least one 3D model and at least one task associated withthe second physical object.
 9. The system of claim 1, wherein theelectronic guide manager is configured to improve the first generatedelectronic guide by at least one of adding a new 3D model to the 3Dmodel repository and modify an existing 3D model in the 3D modelrepository in view of first received usage data.
 10. The system of claim1, further comprising at least one encoded tag producer, the at leastone encoded tag producer configured to generate new encoded tagsassociated with at least one physical object, at least one 3D model, andat least one task.
 11. The system of claim 10, wherein the encoded tagproducer is configured to apply a new encoded tag to new physicalobject.
 12. The system of claim 10, wherein the encoded tag producer isconfigured to add to the database at least one of a new 3D model and anew task.
 13. The system of claim 10, wherein the at least oneelectronic guide manager is configured to request a new encoded tagorder from the at least one encoded tag producer after at least one ofadding a new task to the task repository and modifying an existing taskin the task repository.
 14. The system of claim 1, wherein the 3D modelrepository comprises 3D model object data, and the electronic guidedistribution server is configured to convert the 3D model object datainto a delivery format, and transmit the 3D model delivery format to theuser electronic device.
 15. A system for disseminating electronicguides, the system comprising: a database having a 3D model repositorywith a plurality of 3D models, each 3D model associated with a physicalobject and an encoded tag, and a task repository having a plurality oftasks, each task associated with at least one physical object and atleast one encoded tag, the task having instructions relating to the atleast one physical object; an electronic guide generator configured togenerate an electronic guide having at least one 3D model from the 3Dmodel repository and at least one task from the task repository inresponse to receiving a generation instruction from an electronic guidedistribution server; the electronic guide distribution server inelectronic communication with the electronic guide generator andconfigured to receive from a first user electronic device a firstencoded tag data associated with a first physical object, transmit afirst generation instruction the electronic guide generator associatedwith the first encoded tag data, receive a first generated electronicguide from the electronic guide generator associated with the firstphysical object and the first encoded tag data, transmit the firstgenerated electronic guide to the first user electronic device, andreceive a first transmitted usage data from the first user device; anencoded tag producer configured to generate new encoded tags associatedwith at least one physical object, at least one 3D model, and at leastone task; and an electronic guide manager configured to improve thedatabase by at least one of adding a new task to the task repository andmodifying an existing task in the task repository in view of the firstreceived usage data.
 16. The system of claim 15, wherein the electronicguide manager is configured to request a new encoded tag order from theat least one encoded tag producer after at least one of adding a newtask to the task repository and modifying an existing task in the taskrepository.
 17. The system of claim 15, wherein the electronic guidemanager is configured to improve the database by at least one of addinga new 3D model to the 3D model repository and modify an existing 3Dmodel in the 3D model repository in view of first received usage data.18. The system of claim 17, wherein the electronic guide distributionserver is configured to receive from a second user electronic device asecond encoded tag data associated with a second physical object,transmit a second generation instruction the electronic guide generatorassociated with the second encoded tag data, receive a second generatedelectronic guide from the electronic guide generator associated with thesecond physical object and the second encoded tag data, transmit thesecond generated electronic guide to the second user electronic device,and receive a second transmitted usage data from the second user device.19. The system of claim 18, wherein the electronic guide manager isconfigured to improve the first generated electronic guide by at leastone of adding a new task to the task repository and modify an existingtask in the task repository in view of the first received usage data andthe second received usage data.
 20. The system of claim 19, wherein theelectronic guide manager is configured to improve the second generatedelectronic guide by at least one of adding a new task to the taskrepository and modify an existing task in the task repository in view ofthe first received usage data and the second received usage data.